Non-Mean-Field Behavior of Realistic Spin Glasses 



CM. Newman* 

newman cims . nyu . edu 

Courant Institute of Mathematical Sciences 
New York University 
New York, NY 10012, USA 



D. L. Stein^ 

dls ©physics . arizona. edu 

Dept. of Physics 
University of Arizona 
Tucson, AZ 85721, USA 



Abstract: We provide rigorous proofs which show that the main features of the Parisi 
solution of the Sherrington-Kirkpatrick spin glass are not valid for more realistic spin glass 
models in any dimension and at any temperature. 



The theoretical perspective provided by the Parisi solution of the infinite-ranged 
Sherrington-Kirkpatrick (SK) model ||2T[ has dominated the spin glass literature over the 
past decade and a half. This is partly because it represents the only example of a reason- 
ably complete thermodynamic solution to an interesting and nontrivial spin glass model, 
and partly because of the novel, and in some respects, spectacular, nature of the symmetry 
breaking displayed in the low-temperature phase. Its main qualitative features — the pres- 
ence of (countably) many pure states, the non-self-averaging of their overlap distribution 
function, and the ultrametric organization of their overlaps, among others — have greatly 
influenced thinking about disordered and complex systems in general |l^]. A common 
working hypothesis is that the Parisi solution provides a theory of general spin glass models 
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|T9[. In particular, many authors have directly applied its features to the study of 
both short-ranged models and laboratory spin glasses 0, ^, |, |TT| . Support for this "SK pic- 
ture" — that the main qualitative features of Parisi's solution survive in non-infinite-ranged 
models — comes from both analytical and numerical ||^, work. 

In this Letter, however, we prove that this approach is fundamentally flawed. That is, 
short-ranged models such as the standard nearest-neighbor Edwards-Anderson (EA) model 
cannot have at any temperature all the basic features of the Parisi solution. Furthermore, 
most of our arguments rely on little more than the homogeneity properties of the disorder, 
and thus are applicable to more realistic spin glass models such as models with long-ranged 



couplings or diluted RKKY interactions [p2 
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We do not attempt to resolve in this paper the closely related issue of whether short- 
ranged spin glass models have many pure thermodynamic states at sufficiently high dimen- 
sion and low temperature, or only a single pair. The latter conjecture arises from a droplet 
model [0 based on a scaling ansatz |jl2|, H, |^. Rather, we assert that if there are many pure 
states, their structure and that of their overlaps cannot be that of the SK picture. 

The SK picture. — The Parisi solution, when applied to the EA model at fixed temper- 
ature T, suggests that there exist two related quantities which are non-self-averaging (i.e., 
depending on the realization J of the couplings): (i) a state pjic), which is a Gibbs prob- 
ability measure (at temperature T) on the microscopic spin configurations a on all of Z'^, 
and (ii) a Parisi order parameter distribution Pj{q), which is a probability measure on the 
interval [—1,1] of possible overlap values. These two are related as follows: if one chooses a 
and a' from the product distribution pj{o')pj{a'), then the overlap 



Q=\\m |A^|-1 y: (i: 



has Pj as its probability distribution. Here \Al\ is the volume of a cube A^, of side length L 
centered at the origin in d dimensions. 

A crucial component of the SK picture is that the decomposition of pj into pure states 
is countable (i.e., a sum rather than an integral): 

pjia)=J2W^p'}{a) . (2) 

a 

If a is drawn from pj and a' from pj, then the expression in Eq. (|1]) equals its thermal 
mean, 

qf = hm |A^|-i Y: ■ (3) 



Thus Pj is given by 



Pj{q) = Y.W}Wj^{q-qf) • (4) 

In the SK picture, the W^'s and g^^'s are non-self-averaging quantities, except for a = 
(3 or its global flip (where q^^ = ±qEA)- The average P{q) of Pj{q) over the disorder 
distribution z/ of the couphngs is a mixture of two delta-function components at ig^^ and 
a continuous part between them. 

The countability of the decomposition of Eq. (^ is also employed to obtain the often-used 
result (see, for example, Refs. |jl|, |T3|, 0) that the free energies of the lowest-lying states are 
independent random variables with an exponential distribution. 

Both Pj and Pj are infinite- volume quantities and so must be obtained by some kind 
of thermodynamic limit. Naively, one might simply fix J and attempt to take a sequence 
of increasing volumes with, say, periodic boundary conditions. However, we argued in a 
previous paper that the existence of multiple pure states is inconsistent with the existence 



of such a limit for fixed J . Instead, there would be chaotic size dependence, so that infinite- 
volume limits can be achieved only through coupling- dej^endent boundary conditions. We will 
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see below that, nonetheless, Pj (and pj) can be obtained by natural limit procedures which 
are coupling-independent and which imply translation invariance for Pj (and translation 
covariance for pj). We ask whether this is consistent with the SK picture, which requires 
the following properties of Pj and its average P: 

1) Pj{q) is non-self- averaging. 

2) Pj{q) is a sum of (infinitely many) delta-functions. 

3) P{q) has a continuous component (for all q between the delta-functions at ig^;^)- 

The answer is no; we will see that translation invariance rules out non-self- averaging . 
This in turn makes the absence of a continuous component in Pj inconsistent with its 
presence in P. We conclude that property 1) is absent, and at most one of the remaining 
two properties of the SK picture can he valid for realistic spin glass models. We will consider 
below the implications of this result for other important features of the SK picture, such as 
ultrametricity. 

Construction of pj and Pj. — We first describe a limit procedure to obtain Pj which 
does not involve the prior construction oi pj. Begin with the finite volume Gibbs distribution 
p^j(L) on the spin configuration a^^'' in the cube, A^, with periodic boundary conditions. 
Here J'^^^ denotes the couplings restricted to A^. Let Q^^'^ denote the overlap of a^^'^ and a 
duphcate a'^^^: 

Q(^) = |A,|- E ^i'^^f ■ (5) 

The distribution P^d) for Q^^^ is the finite volume Parisi overlap distribution function, 
whose average was studied numerically in Refs. [^, 

the SK model, non-self-averaging requires P^d) to have chaotic L-dependence as L ^ oo 
for fixed JT"; a similar result was suggested, though not proved, for short-ranged spin glasses 
with many pure states. Because of this, we do not take a limit of P^(l) directly but rather of 
the joint distribution pi oi J^^^ and Q^^^ . That is, by a compactness argument (which may 
require the use of a subsequence of L's) one has a limiting /i, which is a probability measure 
on joint configurations (JT", q) {q being a realization of Q) such that for any (nice) function / 
of finitely many couplings and of q, the average (/) for ft is the hmit of the averages for pi- 

This gives us existence of a p, which is a joint distribution on the infinite- volume realiza- 
tions of i7 and q. Its marginal distribution for J' is the original disorder distribution u, while 
its conditional distribution for q given J' is what we denote Pj. Because of the periodic 
boundary conditions, the marginal distribution (under pl) of Ji, . . . , Jm, q is the same (for 
large L) as of , . . . , J^, q (where a is any lattice translation and JT"" is the translated J') 
and thus one has translation invariance of the limit measure p. Translation invariance here 
means that for any a, the shifted variables JT" together with Q have the same joint distribu- 
tion as do the original JT" together with Q; because u is in any case translation- invariant, this 
implies that Pj = Pja. In other words, the overlaps don't care about the choice of origin. 

Our second procedure for obtaining Pj is first to construct pj and then obtain Pj as 
the distribution of the Q given by Eq. (|I|). The construction of pj- is as follows. Let pi 



20|. It was proved in Ref. |15] that in 
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be the joint distribution for J^^^ and a'^^^ on the periodic cube A^,. Then by compactness 
arguments, some subsequence /i^ converges to a hmiting joint distribution ^{J,a). The 
resulting conditional distribution of a given J is what we denote Pj{(t)- /i will be translation- 
invariant (and pj will be translation-covariant) because of the translation invariance (on the 
torus) of pl- Translation invariance means that the distribution for {J.,(j) is the same 
as for {J"", a"") for any lattice vector a. In terms of pj, this means that pj<^{cr) = Pjio-^""), 
so that, e.g., l^Or^ja = {crx~a)j'-, thus we say that pj is translation-covariant rather than 
invariant. 

Before pursuing the implications of translation invariance, we raise several questions re- 
lated to our constructions. Could different subsequences of cubes yield different limits? We 
believe the answer is no, although we have no complete proof, because our procedure of 
considering joint distributions (for J and q or for J and cr) should eliminate the kind of 



chaotic volume dependence discussed in Ref. [15|. Could different deterministic boundary 



conditions yield different limits? Boundary conditions related to each other by partial or 
complete spin flips (e.g., periodic and antiperiodic) must have the same limiting joint dis- 
tributions (by arguments similar to those used in Ref. [0), but, in principle, unrelated 
boundary conditions such as periodic and free could have different limits. In practice, how- 
ever, we expect that different sequences of deterministic boundary conditions would yield 
the same (translation-invariant) limit. Could the Pj-'s arising from our two constructions 
(one using pj and one not) be different? We shall take as a working hypothesis that the 
two are the same, but see no compelling reason why that should be the case. Either way, 
since both Pj's are translation- invariant, neither one can be non-self-averaging, as we now 
explain. 

Self-averaging of Pj{q). — To justify our claim that translation invariance of Pj{q) 
implies that it is self-averaging, take a (nice) function f{q) (like q'^) and consider the func- 
tion of J', f{J) = J f{q)Pj{q) dq. By translation invariance, /(JT") = fiJ^""), but by the 
translation- erg odicity of u, any translation- invariant (measurable) function f{J^) is equal 
to its jT-average, / f{J^v{^J) dj. Since this is true for all /'s, it follows that Pj itself equals 
its ^/-average. 

We remark that the above discussion makes it clear that our claim is valid for any 
model involving disorder whose underlying distribution is (like v) translation-invariant and 
translation-ergodic. For example, any analogue of the Parisi order parameter distribution 
for spin glass models with site-diluted RKKY interactions will also be self-averaging (if it is 
translation- invariant) . 

Because Pj is self- averaging, we are forced to the dichotomy that, for any temperature in 
any dimension, either P{= Pj) is a sum of one or more 5-functions or else P has a continuous 
component. When there is a unique infinite- volume Gibbs state (e.g., in the paramagnetic 
phase) then of course pj- is that state and P is a single (5-function at = 0. If there were 
only two pure states (related by a global flip) |T0[, then P would simply be a sum of two 
5-functions at -^qEA- But what if infinitely many pure states p'j coexist in pj-, with infinitely 
many overlap values q°fl If the set of overlap values were countably infinite, then Pj would 
necessarily be a sum of (5-functions, but the infinitely many locations (as well as the weights) 
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would not depend on J\ we regard this possibility as implausible. 

Thus we suggest that the most likely scenario for many coexisting pure states and overlaps 
is one where the countable decomposition Eq. is replaced by an integral and where P 
has no 5-function components. 

Ultrametricity. — We briefly turn to the question of whether ultrametricity of pure 
state overlaps can survive in short-ranged spin glasses, given that Pj is self-averaged. 
Clearly, this type of nontrivial ultrametricity requires the existence of multiple pure states. 
As discussed above, we consider the case where P{q) is continuous. We now demonstrate 
that such an overlap distribution cannot have an ultrametric structure, in the Parisi sense. 

Let a, /3, 7i, 72 . . . denote pure states randomly selected from the continuum of such states, 
and let their overlaps as usual be denoted etc. In the Parisi solution, these overlaps 
are such that, for any k, the two smallest of and q^'^'= are equal. For nontrivial 

ultrametricity such as occurs in the Parisi solution, there would be positive probability that 
for some i and j the following two strict inequalities occur simultaneously: 

^^7. < qPi^ and q°^^ > q^^^ . (6) 

If ultrametricity holds, then the first inequality requires that g""^' = g"^, while the second 
inequahty requires that q^'^^ = q"^. Thus q"'^^ = q^^K But because a, /3, 7^, and 7^- are 
chosen randomly and independently, the two variables g""^' = q^"'^ are also independent. 
Because each of these is chosen from a continuous distribution P, the probability that the 
two overlap values can be identical is zero, and we arrive at a contradiction. 

The only way to avoid the contradiction is if the two strict inequalities in Eq. (P) cannot 
occur simultaneously. This means that either q°'""' < q^^'" for every k or vice-versa, which 
implies that the pure states can be ordered into a one- dimensional continuum, and the 
ultrametric structure resembles a comb rather than a more usual tree, such as appears in 
the SK picture. 

As discussed in the previous section (see also the next section), self-averaging makes it 
implausible that the set of overlaps is countable. A countable set of overlaps would invalidate 
the above argument and possibly rescue ultrametricity, but at the cost of destroying anything 
resembling the Parisi solution. 

Decomposition into pure states. — What is the nature of the decomposition oi pj into 
pure states? The SK picture prediction of a countably infinite sum as in Eq. (D (with 
infinitely many qj^^s) has been largely ruled out since the set of qj^^s would be self-averaging, 
which seems unreasonable. Even if one were unwilling to rule out countability on that 
ground, there are other arguments, not presented here, which make that possibility even 
more unlikely. These arguments suggest that all p^'s appearing in a countable decomposition 
would have the same even spin correlations. This certainly seems inconsistent with the 
expected presence of domain walls between pure states unrelated by a global spin flip. We 
conclude that in any reasonable scenario for pj, there should be at most one pair of pure 
states (related by a global spin flip) with strictly positive weight. 

In other words, either (a) pj- is pure, or (b) it is a sum of two pure states related by a 
global flip, or (c) it is an integral over pure states with none having strictly positive weight. 
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or (d) it has one "special" pair of pure states with strictly positive weight and all the rest 
with zero weight. Case (a) occurs if the system is in a paramagnetic phase, or any other in 
which the EA order parameter is zero. Case (b) would occur according to the Fisher-Huse 
droplet picture , but could also occur if there existed multiple pure states not appearing in 
Pj ("weak Fisher-Huse") |2^. Case (c) occurs if there are uncountahly many pure states in 
the decomposition of pj, all with zero weight ("democratic multiplicity"). Case (d) (which 
we regard as unlikely) occurs when one pair of pure states partially dominates all others, 
but accounts for only part of the total weight ("dictatorial multiplicity"). 

What is the relation between the nature of P{= Pj) and the three (nontrivial) cases 
(b) - (d) discussed above? Clearly case (b) implies that P is a sum of two (5-functions at 
-^qEAi and no continuous part. If we assume in cases (c) and (d) that varying a and [3 
through the continuous portion of the pure states yields a continuously varying q^p (but 
see the next paragraph for a case where this assumption is violated), then it follows that 
case (c) corresponds to a P with no 5-functions while case (d) corresponds to a P with 
5-functions at ±g_EA o-nd a continuous part. This latter case is the P predicted by the Parisi 
solution, but note two crucial distinctions between case (d) and the SK picture: (i) there 
is self-averaging, so one already obtains the continuous part of P from a single realization 
JT", and (ii) the (5-functions at -^Qea come from a single special pair of pure states — not 
from countably many g°°'s. Thus any numerical evidence in favor of such a distribution for 
[Pj]a-v Refs. P, |2^) is not evidence in favor of the SK picture but rather, at most, 

supports dictatorial multiplicity. 

We remark that a case of democratic multiplicity occurs in a solution for the ground 
state structure in a short-ranged, highly disordered spin glass model |]TB|. We argued there 
that below eight dimensions, there exists a single pair of ground states (case (b) above), 
while above eight, there are uncountably many. It is not hard to see that the pj for d > 8 
corresponds to case (c) above - the states are chosen by the flips of fair coins for all the 
trees in the invasion forest, so all have equal (zero) weight. It appears that here P{q) is a 
(5-function at zero! So even for short-ranged spin glasses with T > 0, we cannot rule out the 
possibility of democratic multiplicity with such a P. 

Discussion and Conclusions. — We have shown that in realistic spin glass models, and 
probably all non-infinite-ranged spin glasses, a natural construction leads to a Parisi overlap 
distribution Pj which is translation-invariant and hence self-averaging, unlike the Parisi 
solution of the SK model. Although our construction uses periodic boundary conditions, 
we believe that, in short-ranged (and probably all non-infinite-ranged) models, any choice 
of coupling-independent boundary conditions (e.g., free) should yield the same translation- 
invariant Pj. Any restoration of the SK picture would require a non-translation-invariant Pj 
and we see no natural mechanism for obtaining one. Even were such a mechanism available, 
we note that the construction of our self-averaged Pj shows that the SK picture can be, at 
best, incomplete. Any theory of the thermodynamics of realistic spin glasses will likely differ 
considerably from the SK picture. 

If many phases do exist in some dimension and below some temperature, we believe 
that the most reasonable possibility is (c) above, i.e., democratic multiplicity. If numerical 
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experiments find an order parameter distribution that looks similar to that of the Parisi 
solution, our arguments show that it should be interpreted within the context of possibility 
(d) above, i.e., dictatorial multiplicity, rather than as confirmation of the SK picture. 

To summarize our results, we have ruled out non-self- averaging in an extremely large 
class of disordered systems, which include short-ranged and probably all non-infinite-ranged 
spin glasses. Non-self-averaging, and the other main consequences of the Parisi solution, 
including ultrametricity of pure state overlaps, appear to be confined to mean field models. 
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